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Quadratic Convergence of Levenberg-Marquardt Method 
for Elliptic and Parabolic Inverse Robin Problems 

Daijun Jiang* Hui Fengt Jun ZoiC 


Abstract 

We study the Levenberg-Marquardt (L-M) method for solving the highly nonlinear and ill-posed 
inverse problem of identifying the Robin coefficients in elliptic and parabolic systems. The L-M 
method transforms the Tikhonov regularized nonlinear non-convex minimizations into convex min¬ 
imizations. And the quadratic convergence of the L-M method is rigorously established for the 
nonlinear elliptic and parabolic inverse problems for the first time, under a simple novel adaptive 
strategy for selecting regularization parameters during the L-M iteration. Then the surrogate func¬ 
tional approach is adopted to solve the strongly ill-conditioned convex minimizations, resulting in an 
explicit solution of the minimisation at each L-M iteration for both the elliptic and parabolic cases. 
Numerical experiments are provided to demonstrate the accuracy and efficiency of the methods. 
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1 Introduction 


We are concerned in this work with the determination of the Robin coefficient in both stationary elliptic 
and time-dependent parabolic systems from noisy measurement data on a partial boundary. This is a 
highly nonlinear and ill-posed inverse problem and arises in many applications of practical importance. 
The Robin coefficient may characterize the thermal properties of conductive materials on the interface or 
certain physical processes near the boundary, e.g., it represents the corrosion damage profile in corrosion 
detection mm, and indicates the thermal property in quenching processes m- 

For the description of the model problems that are considered in this work, we let Q C R d (d > 1) 
be an open bounded and connected domain, with a boundary <9f2, which consists of two disjointed parts 
dfl = Ti U T a , with R and T a each being a (d — l)-dimensional polyhedral surface. R and T a are 
respectively the part of the boundary that is inaccessible and accessible to experimental measurements. 
Then we shall consider the inverse Robin problems associated with the elliptic boundary value problem 


V • (a(x)Vu) + c(x)m 

= /« 

in 

n, 


a(x)gi+ 7 (x) U 

= ff(x) 

on 

r<, 

(i.i) 


= M x ) 

on 

r„, 



and the parabolic initial boundary value problem 


d t u — V • (o(x)Vm) 

= /CM) 

in 

nx[o,T], 

a(x)f(+ 7 (x) U 

= sOM) 

on 

r* x [o, t\ , 

«( x )§^ 

= h(x,t) 

on 

Ta X [0, T] , 

u(x, 0) 

= U 0 (x) 

in 

ft. 


( 1 . 2 ) 
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The coefficients a(x) and c(x) are the heat conductivity and radiation coefficient, satisfying that a < 
a(x) < a and c < c(x) < c in Q, where a, a and c, c are positive constants. Functions /, g and h are 
the source strength, ambient temperature and heat flux respectively. Both coefficients y(x) in (11.11) and 
ed represent the Robin coefficients, which will be the focus of our interest and is assumed to stay in 
the following feasible constraint set: 

K := 17 € L 2 (Ti)-, 0 < 71 < y(x) < 72 a.e. on F; j, 

where 71 and 72 are two positive constants. For convenience, we often write the solutions of the systems 
ED and ED as w( 7 ) to emphasize their dependence on the Robin coefficient 7 . 

We are now ready to formulate the inverse problems of our interest in this work. 

Elliptic Inverse Robin Problem: recover the Robin coefficient y(x) in (11.11) on the inaccessible 
part Ti from the measurable data z of u on the accessible part r a . 

Parabolic inverse Robin problem: recover the Robin coefficient 7 (x) in (11.211 on the inaccessible 
part Ti from the measurable data z of u on the accessible part T a over the whole time range [0, T\. 

The inverse Robin problems have been widely studied in literature; see 0 m mmm and the 
references therein. The Gauss-Newton method was applied in [5] to solve the least-squares formula¬ 
tion of the elliptic inverse Robin problem, but with no consideration of regularizations. An lA-tracking 
functional approach was suggested for the elliptic inverse Robin problem in [2]. Effectiveness and jus¬ 
tifications of least-squares formulations with regularizations were analysed in mmm for the Robin 
inverse problems, and some iterative methods were applied to solve the resulting nonlinear least-squares 
minimizations. However, we may observe a common feature of these existing methods, which solve 
directly the nonlinear optimizations resulting from least-squares formulations with regularisations, but 
these optimisation problems are highly non-convex as the forward solution u(y) is nonlinear with respect 
to 7 , and strongly unstable at discrete level with fine mesh sizes and time step sizes due to the severe 
ill-posedness of the inverse problems and the fact that noise is always present in the observation data. 

In order to alleviate the effects of these drawbacks, we shall apply the L-M iterative method 100 
m m to solve the nonlinear optimizations resulting from least-squares formulations with regularisations 
for the concerned inverse Robin problems. With the L-M method, we need only to solve a convex 
optimization at each iteration. Furthermore, in combination with the surrogate functional technique, 
we will not require the solution of any optimisation problems in each iteration as the minimisers can be 
computed explicitly. Another important novelty of this work is its establishment of the quadratic rate of 
convergence of the L-M method for both the elliptic and parabolic inverse Robin problems. This appears 
to be the first time in literature to demonstrate the quadratic convergence of the L-M method for a highly 
nonlinear ill-posed inverse problem. Compared with general optimal control problems or general direct 
nonlinear optimisation systems, the analysis on the quadratic rate of convergence of the L-M method here 
is much more delicate and tricky, due to the severe ill-posedness, high nonlinearity and strong instability 
of the current inverse problems and the direct effect on the convergence from two crucial parameters 
involved, namely the regularization parameter and the noise level in the data. 

The rest of the paper is organized as follows. In Section[2j we discuss the uniqueness of the nonlinear 
elliptic and parabolic inverse Robin problems. In Sections[3] and 0 we formulate the Tikhonov regu¬ 
larizations for the nonlinear elliptic and parabolic inverse Robin problem respectively and study some 
mathematical properties of the resulting nonlinear optimisations. In Subsections 13.11 and 14.11 Frechet 
derivatives of the forward solution of ED and ED and corresponding adjoint operators are derived 
respectively. In Subsections 13.21 and 14.21 the L-M iterative methods are formulated and their quadratic 
convergences are established. The surrogate functional approach is applied in Subsections l3.3l and 14.31 to 
solve the convex minimization at each L-M iteration for the nonlinear elliptic and parabolic inverse Robin 
problem respectively. Several numerical experiments are presented in Section[5]to illustrate the efficiency 
and accuracy of the proposed methods. Some concluding remarks are given in Section[ 6 ] 

Throughout this work, C is often used for a generic positive constant. We shall use the symbol (•, •) 
for the general inner product, and write the norms of the spaces L 2 (fl), H l ^ 2 {T) and L 2 { F) (for 

some T c dCl) respectively as || • || m ,n, || • ||n, || • ||i/ 2 ,r and || • || r . 
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2 Uniqueness and local Lipschitz stability of the inverse Robin 
problems 


In this section, we shall demonstrate the uniqueness and local Lipschitz stability of the Robin coefficients 
in the concerned nonlinear elliptic and parabolic inverse Robin problems. 

We first study the uniqueness and local Lipschitz stability of the elliptic inverse Robin problem. 


Theorem 2.1. (Uniqueness of the elliptic inverse Robin problem) Let 71 and 72 be two solutions 
to the elliptic inverse Robin problem as stated in Section[]\ and df 2 be C 2 smooth. Furthermore, we 
assume that meas({x £ Tj; u(x) = 0}) = 0 where u is the solution to the forward system 11 . 1 11 . then 
71 = 72 almost everywhere onTi. 

Proof. It is straightforward to verify using m that 11(71) — 11(72) satisfies 


-V • (a(x)V(u(7i) - 11(72))) +c(x)(u(7i) - 11(72)) 

a ( x )9 MuIzhUiH 

11(71) -11(72) 


0 in f l, 
0 on r a , 
0 on r a , 


and on the boundary Li, 


i(x) 


9(11(71) - 11(72)) 
dn 


+ - 7211(72) = 0. 


( 2 . 1 ) 


( 2 . 2 ) 


The unique continuation principle [8] implies that 11(71) — 11(72) = 0 in JL Hence, by the trace theorem 
and the weak form of the system EH), we have 


I 1 11(71) - 11(72) Han < U||u(7i) - 1^(72)|| 1,0 = 0 , 


and for any <p £ H 1 ^), 

f 9(u(7i)-11(72)) 

Jr, W dn 

Therefore we immediately see sthat 

9(11(71) - 11(72)) 


ipds = / a(x)V(u(7i)— 
J n 


i(x)- 


9 n 


= 0 and 


which, along with (12.21 1 . leads to 


11(72)) • V<£ + c(x)(u(7i) - u(7 2 ))<pdx = 0 . 


11(71) = 11(72) on r i} 


u(7i)(7i - 72) = 0 on Tj. 

Now the assumption that meas({x £ Lj : u(x) = 0 }) = 0 implies 71 = 72 a.e. on Tj. jj 

For the local Lipschitz stability, let 7* be the true Robin coefficient, we shall write for any positive 
constant b that 


N ( 7 *, 6 ) = {7 £ K ; || 7 -7lr«<&}. (2.3) 

Then we refer to [S| and give the following theorem to show the local Lipschitz stability. 

Theorem 2.2. (Local Lipschitz stability of the elliptic inverse Robin problem) Assume that 
11 ( 7 *) > co > 0 on Tj, then there exists a positive constant b such that the following stability estimate 
holds: 

||u(7i) - 11(72)||r a > U||7i - 72||r 4 V7i,7 2 £ N(7 *, b ) ■ (2.4) 

Next, we study the uniqueness and local Lipschitz stability of the parabolic inverse Robin problem. 

Theorem 2.3. (Uniqueness of the parabolic inverse Robin problems) Let 71 and 72 be two 

solutions to the parabolic inverse Robin problem as stated in Section[I[ and 9 f 1 be C 2 smooth. Moreover, 
we assume that meas({x £ u(x, t) = 0 for t £ ( 0 ,T)}) = 0 , where u is the solution to the forward 
system HM, then 71 = 72 almost everywhere on Vi. 
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Proof. It is straightforward to verify using m that u{ 71) — u( 72) satisfies 


d t (u( 71) - 1/(72)) ~ V • (a(x)V(u(7i) - u( 72))) 

/ x \ 9M7iMd72)) 
My-*-/ Q n 

u{ 71) - ^(72) 
(u(7i) - w(7 2 ))(x,0) 


0 in Hx[ 0 ,T], 
0 on r a x [ 0 , T ], 

0 on r a x [ 0 , T ], 

0 in , 


( 2 . 5 ) 


and on the boundary T* x [ 0 ,T], 

a(x) ^( M ( 71 ^ U + 7iu(7i) - 721/(72) = 0. (2.6) 

The unique continuation principle [ 5 ] implies that 1/(71) — u(y 2 ) = 0 in O x [ 0 ,T], Hence, by the trace 
theorem and the weak form of the system ( 12 . 51 ) . we have 


IH 7 i) - u("/ 2 )\\an < C||m(7i) - u(72)||i,n = 0, 
and for any tp £ L 2 ( 0 , T; ff 1 (H)), 

[ [ a (x) d( M ( 71 ) ~ M ( 72 )) ydsdt = [ [ a(x)V(u(7i)-u(7 2 )) ■ V^dxdf 

Jo Jr* Jo Jn 

+ [ [ dtiuim) - u(j 2 ))ipdxdt = 0 . 

Jo Jn 


Therefore we immediately see that 

a(x) d( M ( 71 ^ — 0 anc i u^i) = u^) on TiX[0,T], 
which, along with ( 12 . 61 ) . yields sthat 


w( 7 i)( 7 i - 72) = 0 on Tj x [ 0 ,T]. 


Now the assumption meas({x £ T^; u(x, t) = 0 for t £ ( 0 ,T)}) = 0 implies 71 = 72 a.e. on T,. D 

For the local Lipschitz stability, we also refer to [ 5 ] and give the following theorem to show the local 
Lipschitz stability. 

Theorem 2.4. (Local Lipschitz stability of the parabolic inverse Robin problem) Assume that 
u( 7*) > Co > 0 on Tj x [0,T], then there exists a constant b > 0 such that 

||u( 7 i) - u( 7 2 )|| L 2 ( 0jT ; L 2 (r a )) > CH71 -72II1V V71,72 £ N( 7*, 6). ( 2 . 7 ) 


3 Elliptic inverse Robin problem and its L-M solution 

3.1 Tikhonov regularization for elliptic inverse Robin problem 

In this section we first formulate the Levenberg-Marquardt method for solving the nonlinear non-convex 
optimisation problems resulting from the least-squares formulation of the elliptic inverse Robin problem as 
stated in Section]!] incorporated with Tikhonov regularization to handle its ill-posedness and instability 
due to the presence of the noise in the observation data [ 12 ] ■ We assume the noise level in the observation 
data z s of the true solution u to the elliptic system m is of order 5 , namely 

IH7*)-J|k<<5, (3.1) 

where 7* is the true Robin coefficient. The elliptic inverse Robin problem is frequently transformed into 
the following stabilized minimization system with Tikhonov regularization: 

minj(7) = IK7) “ J|lr a + ^IMIr, > ( 3 - 2 ) 

7 eiv 

where /? is the regularization parameter. The formulation ( 13 . 21 ) was shown to be stable in the sense that 
its minimizer depends continuously on the change of the noise in the data z s [ 12 I| . 
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For the subsequent analysis on the convergence of the Levenberg-Marquardt method for solving the 
optimisation ( 13 . 21 ) . we shall frequently need the Frechet derivative of the forward solution w(y) of system 
m- Let w := u'(7)d be the Frechet derivative at direction d, then it solves the following system: 

{ —V • (a(x)Vin) + c(x)u; = 0 in 11 , 

a ( x )§F+'? w; = -dui-y) on r i; ( 3 . 3 ) 

°( x )If = 0 on r a . 

Let 1 /( 7 )* be the adjoint operator of the Frechet derivative u'( 7), then it it easy to verify that w* := 
u '(l)*P G iL 1 (fl) at a general direction p solves the following system 

( — V • (a(x)Vic*) + c(x)w* = 0 in Q , 

< a(x)^+ 7 u>* = 0 on T t , ( 3 . 4 ) 

l a ( x )i£r = ~P u h) on r Q . 

The following lemma gives an important relation for our later study. 

Lemma 3.1. The following relation holds for any directions d and p: 

(w, u('y)p) Ta = (u{j)d, w*) Ti . ( 3 . 5 ) 

Proof. For any tp,if £ 1 L 1 (S 1 ), we can readily derive the variational forms of systems ( 13 . 31 ) and ( 13 . 41 ) : 


/ a(x)Vw • V^dx + / c(x)uiy?dx = / (—du('y) — "fw)ipds, 

JQ JQ, JTi 

/ a(x)Vui* • \7ipdx. + / c(x)u;*'0dx = — / 7 w*ij)ds~- / pu^ifds. 
2 Jn ./iy Jr a 

Now (13.51) follows by taking ip = w* and 1 p = w respectively in (13.61) and (13.71) . 


( 3 . 6 ) 

( 3 . 7 ) 
« 


3.2 Levenberg-Marquardt method and its convergence 

The nonlinearity of the forward solution u{ 7) of the system ( 11 . 11 ) makes the minimization (| 3 . 2 I) highly 
nonlinear and non-convex with respect to the Robin coefficient 7, as well as strongly unstable at discrete 
level with fine mesh sizes and time step sizes due to the severe ill-posedness of the inverse problem and 
the fact that noise is always present in the observation data. To alleviate these difficulties in numerical 
solutions, we shall apply the Levenberg-Marquardt method to solve ( 13 . 21 ) . For a given 7 £ I \, we apply 
the linearization 


u( 7 ) «m(7) + w , (7)(7~7), 

then we may solve the minimization system ( 13 . 21 ) by the following Levenberg-Marquardt iteration, which 
is widely used for general nonlinear optimization problems H m : 

j{ 7 fc+1 ) = min J{j) ~ |K( 7 fe )(7 - 7 fc ) - (z s - M(7 fc ))llr a +/?fc|l7 ~ 7 fc |lry • (3-8) 

7 eK 

Before our study of the convergence of the iteration ( 13 . 81 ) . we shall develop some auxiliary results. 

Lemma 3 . 2 . Assume the forward operator u{ 7) of system \ 1 . 1 \) satisfies that u( 7) £ L°°(Fj) for 7 £ K , 
then there exist two positive constants L and c 1 such that the following estimates hold for all 7, 7 £ K : 

IK7) -«(7)llr a < L||7-Tiliy, (3.9) 

l|M , (7)(7-7)-(M(7)-w(7))llr a < ci||t — 7||r* • (3-10) 

Proof. From the variational form of the system m, we can easily find that 


/ a(x)V(w(7) — w(t)) • \ 7 ipdx + / c(x)(m(t) — ui^yjtpdx. 
Jn Jn 

+ j 7(^(7) — u{*f))pds = - J (7 — j)u(j)ipds. 


( 3 . 11 ) 
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Taking <p = u(pf) — u( 7 ) and using the lower bounds of a(x), c(x), and 7 , we derive 

min{a, c}||m( 7 ) - u( t)||?,£ 7 + 7i||«(7) - «(7)llr» <\ J (l~ iM'y)(u('y) - u(y))dsj 
< ll^(7)IU°°(roIl7 - 71kIK 7 ) ~ w(7)|| r< < CH 7 - 7 llrJ|u( 7 ) - u(7)llrv 
Then it follows by the Cauchy-Schwarz inequality that 

min{a,c}||M( 7 ) - u(7)lli,n < ^\\l ~ 7llr 4 ■ 

Now estimate (13.91) follows directly from this inequality and the trace theorem. To verify the estimate 
(13.101) . we first show 

IK(7MU < CIMHiv (3.12) 

Indeed, choosing p = v!{~j)d in (13.61) . we readily get 

[ a(x)|V(rt , ( 7 )d)| 2 (ix + f c(x)|rt , ( 7 )d| 2 dx + f 7 |rt , ( 7 )d| 2 ds = — f du^)^'[p/)d)ds. 

Jn J n Jri J r 4 


Then it follows by the Cauchy-Schwarz inequality that 


C 2 


min{a,c}||u , (7)d||? i n < — ||d||r 4 , 

which, along with the trace theorem, gives (13.121) immediately. 

Next, we prove the estimate (13.101) . Taking 7 = 7 and d = 7 — 7 in (13.61) . we have 

/ a(x)Vu / (7)(7 — 7) • Vipdx + / c(x)u , ( 7)(7 — 7)<^<ix 
Jn Jn 

+ J 71 /( 7)(7 — ^/)ipds = — j (7 — 7 )m( 7 )< / 9 cZs V £ i /" 1 (fi). 


(3.13) 


Subtracting (13.131) from (13.111) yields 


+ 


/ a(x)V(u , ( 7 )( 7 - 7 ) - (u(y) - u(j))) ■ V<pdx+ / 7 (^( 7)(7 - 7 ) - (^( 7 ) - u(y)))ipds 
Jn J r 4 

/ c(x)(u'(7)(7- 7 ) - (u( 7 ) - u{j)))tpdx = / ( 7 - 7 )(w( 7 )-u( 7 ))</?ds. 

Jn J r. 


Then applying the trace theorem, Lagrange mean value theorem and inequality (I3.12|l . we derive 

Ik( 7 )(7 - 7) - (u(l) - u(7))|| r „ < C'||u , ( 7)(7 - 7 ) - W 7 ) - u(7))||i,n 
< C||(7-7)(m( 7) - u(7))||r 4 = C'll (7 — 'T)«'(€)(7 — ’T)llr i < C 1 II 7 - 7|| 2 ., 


where £ is some element in K between 7 and 7 . j) 

Now we are ready to establish a quadratic rate on the convergence of the Levenberg-Marquardt 
method (13.81) . under the following basic condition: 


IN7) - «(7*)llr a > c 2 ||7 — 7*Hr 4 V 7 £iV( 7 *,&) (3.14) 

where C 2 and b are two positive constants with b £ (0,1). Here N( 7 *,&) denotes the ^-neighborhood 
of the true Robin coefficient 7 * £ K defined in (12.31) . Assumption (13.141) is the frequently adopted 
basic condition to ensure the quadratic convergence of the Levenberg-Marquardt method for most direct 
nonlinear optimization problems [4] |16) . so it is natural to bring it to the current nonlinear ill-posed 
inverse problems. The condition (13.141) may be viewed as a direct motivation of the local Lipschitz 
stability of the elliptic inverse Robin problems (see estimate (12.41) in Theorem 12.21) . 

It is a well-known technical difficulty in a practical numerical realisation of any Tikhonov regularised 
optimisation system like the ones m and m to choose a reasonable and effective regularization 
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parameter /3 or /3 k - Another important novelty of this work is our suggestion of a very simple and easy 
implementable choice of the parameter (3k based on the following rule: 


& = IK7 fc )-* 5 Hr a - 


(3.15) 


And surprisingly, as we shall demonstrate below, this choice of the regularization parameter (3k ensures 
a quadratical convergence of the resulting Levenberg-Marquardt iteration (13.81) . 

Considering the presence of the noise (see (13.11) ), it is reasonable for us to terminate the L-M iteration 
(13.81) when its minimizer y fc is accurate enough in terms of the noise level, more specifically, we shall 
terminate the iteration if the following criterion is realised: 

C 2 |l 7 fc - 7 lr« <2* or ||u(7 fe ) — 2 4 ||r„ < VS. (3.16) 

Lemma 3.3. Under the conditions {3.1$ , (13.151) and 113. 160 . if "/ k € Nfy*,b) then 7 k+1 generated by 
the iteration m satisfies 

ll«'(7 fc )(7 fc+1 -7 fc )-(^-«(7 fc ))Hr a < c 3 (||7 fe -7lr,+<5), (3.17) 

Il7 fc+1 -7*ll^ < C4(||7 fc -7*ll^+«y), (3-18) 


where constants c 3 and c\ are given explicitly by c 3 = y / max{2c? + 2 L 2 + 1, 3} and C 4 = max! +1, 2}. 

Proof. As 7 fe+1 is a minimizer in (13.81) . we derive using the estimates (13.11) . (13.91) - (13.101) . equality (13.151) 
and the Cauchy-Schwarz inequality 

IK(7*)(t* +1 - 7 fc ) - (Z* - u( 7 fe ))||? a < J( 7 fc+1 ) < j(7*) 

= l|w'(7 fc )(7* - 7 fc ) - («(7*) - W)) + «(7*) - z*\\l a + MV - V\\h 

< 2c?|| 7 fc - 7*Hr* + 25 2 + ||u( 7 fc ) - «( 7 *) + «(7*) - *Xj7* - VWl, 

< 2c?|| 7 fc - 7*Hr* + 25 2 + 2L 2 || 7 * - 7 fc ||r i + 2A 2 || 7 * - 7 fc |lr, 

< (2c? + 2 L 2 + l)|| 7 fc - 7 *||p 4 + (2 + 5 2 )5 2 

< max{2c? + 2 L 2 + 1, 3 }(|| 7 fc - 7 *||p. + S 2 ), 
which implies (13.171) immediately. 

Again, using the minimizing property of 7 A;+1 in (13.81) and the estimates (13.11) and (13.101) . we can 
deduce as follows: 


< 


||7 fe+ 1 -7 fc Hr i <^(7 fe+ 1 )<^(7*) 
^IK(7 fe )(7* - 7 fc ) - (z* - «(7 fe ))llr a + 117* - 7*11* 
^(2c?|| 7 fc -7l^+2«5 2 )+||7*-7 fc ||r i 


2cj||7 fc ~7ll^ 

||u( 7 fc ) - z s \\ 2 a 


2 S 2 
IK7*0 - 


+ 117* 



(3.19) 


As stated in (13.161) . the iterative process (13.81) terminates if C 2 II 7 
Vd. Otherwise we have C 2 || 7 fc — 7 * Hr, > 25 and ||u( 7 fe ) — z 4 ||r 0 
n 7 k 2 . s jus < 25 and 


fc -7*lk < 25 or ||u( 7 fc ) - * 4 ||r B < 
> VS. Then we can easily see that 


ll«(7*) - z*\\ Ta > \\u(V) - «(7*)llr a - IK7*) - * 4 ||r B 

> c 2 ||7 fc - 7*Hr. - <5 > c 2 || 7 fe - 7*lk - f b* - 7*llr, = f b* - 7 *Ik • 

Now the desired result (13.181) follows readily from these two estimates and (13.191) . ft 

Lemma 3.4. Under the conditions J 3.1f\) , 13.150 and 13.160 . let V and 7 fc+1 be two consequent iterates 
generated by the iteration LI. 80 such that both V and 7 fc+1 He in IV ( 7 *, b), then 

||7 fc+1 -7*lk<c 5 (||7 fe -7*lk+5), (3.20) 


where constant C 5 is given explicitly by C 5 = (c 3 + C 1 C 4 + l)/c 2 . 
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Proof. It follows from (13.141) . (13.101) . (13.17[) and (13.181) that 

c 2 ||7 fe+1 - 7*lh < ||«(7 fc+1 ) - «(7*)lk < ||«(7 fe+1 ) - * 4 |k + 8 
= \\u(l k )h k+1 l k ) + u(7") ~z s - {«'(■ 7 fc )(7 fc+1 - 7") + «(7") - «(7* +1 )}lk + <5 

< \W{l k ){l k+1 7 fe ) + U( 7 fe ) ^ * 4 )||r„ + \\u'h k )h k+1 - 7 fe ) + u ( 7 fe ) - u( 7 fc+1 )|k + <5 

< c 3 (||7 fc -7lr i +^)+ci||7 fc+ 1 -7 fc ||^+^ 

< c 3 (|| 7 fe - 7*IITi + S) + cic 4 (|| 7 fe - 7*IITi + S) + S 

< (c 3 +c 1 C 4 + l)(||7 fe -7lr < +<5), 
which implies the estimate (13.201) . j) 

In order to establish the quadratic convergence of the L-M iteration, we now emphasize the dependence 
of all the constants ci, ■ • •, C 5 in our previous estimates on the radius 6 of the ball N( 7 *, b). First, we 
know both constants c 3 and c 3 in (13.101) and (13.171) are independent of b. But constant ci in (13.141) 
depends on this radius 6 , so we will write 02 (b) to emphasize this dependence. Similarly, we can write 
the constants c 4 and C 5 in the estimates (13.181) and (13.201) as 04 (b) and 05 (b). 

We are now ready to establish our major convergence results in this work, the quadratic convergence 
and quadratic rate of convergence for the Levenberg-Marquardt iteration (13.81) . For simplicity, we set 

( 6 -a/c 4 (|)<U 1 f I j - \ 

r(b,S) = min j 6 , -— -}, a = c 5 (-) (yc 4 (-) + lj , 

\Jc 4 (\) + 1 

m = <5cb(|)(^(|) + l) + \J 04 ^) 8 . (3.21) 

We can readily see from (13.91) and assumption (13.141) that 02 (b) < L, using which we can directly check 
from the definitions of c 4 and C 5 that 05 (b) > y/2 and c 4 (b) > 2. Using these we know a > 3, and 
1 + a/1 — 4a(3( 8 ) < (2a)/3, which will be used in the following theorem. 

Theorem 3.1. Under the conditions \3.1f\j , \3.15 1) and IS.lfil) . we assume 8 is small enough such that 

r(b , <5) > 0, 1 — 4a/3( 8 ) > 0 and choose b £ [ 1 then for any 7 0 £ N(j*, r(b, 8 )), 

the sequence {q fc } generated by \3.8\) stays always in N(j*,b) and satisfies 

||7 fe+ 1 -7lr i <c 5 (i)(|| 7 fc -7l^+<5)- 

Proof. From the results of Lemma [3~T1 we only need to show that the sequence { 7 ^} generated by (13.81) 
stays always in N(-y *, b). This is proved below by the mathematical induction. 

First, by the choice b we know 0 < b < 1/3, we know 7 0 £ N(j*, r(b, 8 )) C N( 7 *, 1/3). Then by the 
triangle inequality and estimate (13.181) with 6=1/3 we can deduce 

Il7 1 -7lr i < II7 1 - 7°Ik + ||7° - 7*llu < (^(|) + 1)||7° - 71k +^ 4(^)8 

< (^c 4 (i) + l)r( 6 , <5) + \j c 4 (^)<5 < 6 , 

which implies 7 1 £ N( 7 *, 6 ) C N( 7 *, 1/3). 

Now we show 'y l+1 £ N( , y*,b) if j k £ N( 7 *, 6 ) for k = 1,...,/. Indeed, we deduce from the triangle 
inequality, the estimate (13.181) for 7 1 £ N(j*,b) and the estimate (13.201) for 7 Z , 7 Z_1 £ N(j*,b) that 

Il7 m -7*lh < ||7 m -yik + ll7*-7*lk 

< (]f^) + l)h l -7lr i + ^/o 4 (^)8 

< (\[^(|) + l)c 5 (i)(||V - 1 - 7*Hr* + 6 ) + ^c 4 (i )6 

< ab 2 + /3(8) < b , 
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(3.22) 























































which implies that r ) l+1 £ N( 7*, b), if it holds that ab 2 + ft (6) < b. 

To see ab 2 + /3(d) < b , we define a quadratic functional f(b) = ab 2 — b + /?(<$). As 1 — 4a/3 (5) > 0, it is 

easy to see 0 < bi = 1 <1/6 and b\ < b 2 = 1+7/ )~ 4a ^ < 1/3, and 61 and b 2 are two solutions 

of fib) = 0. Clearly for any b £ [iq, b 2 \, we know f(b) < 0, namely, ab 2 + /3(S) < b. (| 


3.3 Surrogate functional technique 


In each step of the L-M iteration we have to solve the minimization problem (13.81) . Let us now derive its 
optimality system, i.e., J'( 7 fc+1 )f = 0 for any £ £ L 2 { Tj). By direct computations, we have 


j'm 


2(«'(7 fc )(7-7 fc ) 

2 ( U ( 7 fc ){«'( 7 fc )*( 


- (z 5 - u( 7 fe )), u'(7 fc )(0>r o + 2/3 fc < 7 - 7 *, Or, 


7*,{)i 


where we have used the adjoint relation (13.51) . This is equivalent to the following equation: 




u(^)W(^n- 


u( 7 fc ) 


-)} + /9 fc (7-7 fe ) = «(7' c )K(7T(- 


u( 7 fe ) 


)}• 


(3.23) 


So we have to solve this rather complicated linear system (whose discretized system is highly ill-conditioned) 
to get the solution 7 fe+1 at each iteration of (13.81) . e.g., by some iterative method. This is still difficult 
and computationally very expensive. 

Next, we shall make use of the surrogate functional technique to greatly simplify the solution to 
the minimization (13.81) . resulting in an explicit solution at each iteration. The resultant algorithm is 
computationally much less expensive. The surrogate functional technique was studied in [3] for solving a 
linear inverse operator equation of the form Kh = f. We now construct a surrogate functional J s ( 7 , 7 fc ) 
of J(y) in (13.81) : 

J s ( 7,7*) = A 7) + 417 - 7 fe |lr, - lK(7 fc )(7 - 7 fc )llr„, (3-24) 

where A can be any positive constant such that ||u'( 7 fe )d||p < .A||d||p. for all d £ L 2 {Ti). Next, we will 
simplify the expression (13.241) . Using the adjoint relation (13.51) . we can rewrite J s ( 7 , 7 fc ) as follows: 


J s ( 7 ,7 fc ) = lk(7 fc )(7 - 7*) - {z S - «(7 fc ))llr„ + Ah - 7 fe Hr, + 417 - 7*11^ 

-||u , ( 7 fc )(7-7 fe )llL 

= - 2 (u '( 7 fe )(7 - 7 *), z* - u(A))r a + Ah ~ 7 fc ||r, + Ah - 7 fc |lr, 

+ ll* 4 -«(7*)ll£ a 

= - 2(7 - 7 *, u( 7 fc ){u / ( 7 fc )*( Z '~ 7 y )})r, + Ah A\\h 

+Ah-A\\l + h 5 -uh k )\\ 2 r a 

= A\\j - 7 fe - ^( 7 fc )K( 7 fc )*( Z '~ ( ^ fc) )}|l^ + Ah - 7 fc |lr, 

+ {h S - u ( 7 fc )llr a - A\\juh k ){u’h k r ( 3 - 25 ) 


We can see that the last term above is independent of 7 , so does not affect the minimization. Hence we 
will drop that term in the functional J s ( 7 , 7 *) and obtain 


min J s ( 7 , 7 fe ) = minH 7-7 k ~ ^uh k )lu'h k )* (- — 7 ~TT~^ )} „ + Afc||7 “ 7 fc ||rv 
76 K 76 K A L u( J r. 


u( 7 fc ) 


7 GK 7 GK 

This is a simple quadratic minimization, and we can compute its minimizer exactly: 

. T sr fc7 k , 1 t kh n k\* r z& ~A 7 fc Kl 

“S mJ h -7 >=7 +Tm u(l H “ (7 ) ( ,( 7 *) ) j- 


(3.26) 


(3.27) 


This motivates us with the following reconstruction algorithm for the Robin coefficient in (Ob which is 
clearly much easier and computationally much less expensive than solving the minimization (13.81) directly. 
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Algorithm 3.1. Choose a tolerance parameter e > 0 and an initial value 7 , and set k := 0. 
1. Compute 7 fc+1 : 


7 


fc+i 


7 fc + 


A + Pk 


w(7 fc ) 


u\i k n 


z 5 - u{ 7 fc ) 
u("f k ) 


)}■ 


(3.28) 


ll-yfe + i ||r 

2. If —M—jqj-- < e, stop the iteration; otherwise set k := k + 1, go to Step 1. 


4 Parabolic inverse Robin problem and its L-M solution 

4.1 Tikhonov regularization for the parabolic inverse Robin problem 

In this section we first formulate the Levenberg-Marquardt method for solving the nonlinear non-convex 
optimisation problems resulting from the least-squares formulation of the parabolic inverse Robin problem 
as stated in SectionQ] incorporated with Tikhonov regularization to handle its ill-posedness and instability 
due to the presence of the noise in the observation data m We assume the noise level in the observation 
data z s of the true solution u to the parabolic system Ol is of order S, namely 


[ T ll u ( 7 *) ~ zS \\r a dt < S 2 . 
Jo 


(4.1) 


where 7 * is the true Robin coefficient in the system m- The parabolic inverse Robin problem is 
frequently transformed into the following stabilized minimization system with Tikhonov regularization: 


mm 

76 K 


J(l) = [ IK7)-2 5 ||r 0 d * + 

Jo 


(4.2) 


where /3 is the regularization parameter. The formulation (14.21) was shown to be stable in the sense that 
its minimizer depends continuously on the change of the noise in the data 

For the subsequent analysis on the convergence of the Levenberg-Marquardt method for solving the 
optimisation (14.21) . we shall frequently need the Frechet derivative of the forward solution 14 ( 7 ) of system 
m- Let w := u'0i)d be the Frechet derivative at direction d , then w 6 L 2 (0, T; U 1 (fl)) solves the 
following system: 

— V • (a(x)V w) = 0 in flx(0,T), 


a ( x )f^+ 7 M’ = ~du( 7 ) on rjX( 0 ,T). 


aWtf = 0 

w(x, 0 ) = 0 


on r a x (0, T ), 
in Q , 


(4.3) 


Let u'{ 7 )* be the adjoint operator of the Frechet derivative u'{ 7 ), then it it easy to verify that w* := 
u '{l)*P 6 L 2 (0, T ; U 1 (fl)) at a general direction p solves the following system: 


-d t w* - V- (o(x)Vw*) = 0 

a(x)^f+ 7 ^ = 0 


\ dw 
' dr\ 

w* (x, T) = 0 


in fl x [0, T ], 
on F,; x [0, T ), 


a ( x )^T = ~P U ( 7) on F a x[0,T], 


(4.4) 


in f l. 

The following lemma gives an important relation for our later analysis. 
Lemma 4.1. It holds for any directions d and p that 


f T 

(u(j)w, p)r a dt = (d, / u('y)w*dt)r i . 
Jo 


(4.5) 


Proof. For any <p,if G L 2 (0, T; 7J 1 (n)), we can readily derive the variational forms of (14.31) and (14.41) : 

/ / dt/wpdxdt + / / a(x)Vw ■ Vipdxdt = / (—du( 7 ) — 7 w)ipdsdt, (4.6) 

Jo Jn Jo Jn Jo Jt, 
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dtw* i/jd'xdt 


/o Jn 


n 

/o Jn 


a(x)V«J* ■ Vipdxdt 

r rT 


r )W* 1 pdsdt — 


/ 0 JTi 


'o Jr a 


pu("/)ipdsdt. 


(4.7) 


By integrating by parts with respect to t in (14.71) . we derive 

— f w*(x, T)-i/>(x, T)dx + f u>*(x, O)'0(x, 0)dx + f f d t ipw*dxdt 

Jd J Q J 0 Jfl 

+ f [ a(x)Vu)* • Vipdxdt = — f ( jw*ipdsdt — I [ pu(p))ipdsdt. 

Jo Jn Jo JTi Jo Jr a 

Taking <p = w* in (14.61) . ip = w in (14.81) and noting that w*(x, T ) = u>(x, 0) = 0, we can easily find that 

f (u(i)w, p)r a dt = f (d, u{ r ))w*)T i dt = (d, f u('y)w*dt)r i - tt 

Jo Jo Jo 


(4.8) 


4.2 Levenberg-Marquardt method and its convergence 

The nonlinearity of the parabolic forward solution u( 7 ) of the system (11.21) makes the minimization (14.21) 
highly nonlinear and non-convex with respect to the Robin coefficient 7 , as well as strongly unstable 
at discrete level with fine mesh sizes and time step sizes due to the severe ill-posedness of the inverse 
problem and the fact that noise is always present in the observation data. To alleviate these difficulties in 
numerical solutions, we propose to solve the minimization (14.21) by the Levenberg-Marquardt iteration: 

J(l k+1 ) = min J(7) =: / IK(7 fe )(7 “ 7*) - O' 5 - u(j k ))\\^ dt + /3 fc ||7 - 7 fc |lr, • ( 4 - 9 ) 

J Q 

Before our study of the convergence of the iteration (14.91) . we establish some important auxiliary results. 

Lemma 4.2. Let u(q) be the forward operator of the system 11. 2\) and 11 ( 7 ) £ L 2 (0, T; L°°(Ti)) for 7 £ K, 
then there exist positive constants L and ci such that the following estimates hold for any 7 , 7 £ K: 

IH7) -u{j)\\l a dt < L||7-7llr i5 ( 4 - 10 ) 

/ ||u'(7)(7-7)-(u(7)-u(7))||£ a df < ci||7 — • ( 4 - n ) 

Jo 

Proof. From the variational form of the system 0 , we can easily see for any ip £ L 2 ( 0 , T ; i7 1 (S2)) that 



+ 


d t (u(j) 

7H7) 


— w(7))V3(ix + 

— u(fy))ipds = 


/ a(x)V(w( 7 ) — u(j)) ■ Vpdxdx 

Jn 

- / (j ~ l)u(j)ipds. 


(4.12) 


JTi JTi 

Taking ip = u( 7 ) — m( 7 ) in (|4.12l) and integrating by parts with respect to t over [0, r] for r £ [0, T], then 
using the Cauchy-Schwarz inequality, we derive 


|||u(7)(x,r) - u(y)(x, t)||q + a J ||Vu( 7 ) - Vu^W^dt 

z dt<\ f f - ; y)u{'y)(u{'y) - u{j))dsdt\ 
Jo JTi 

< l|M(7)IU 2 (0,T;L->(r i ))V / 7 : ||7^ 7l|r 4 |K7) - 

< C||7 - 71kIK 7 ) - M( 7 )||L 2 (0 T;i 2 (r . )) . 


+7i / l|w(7)-«(7)llr 
Jo 


Now a direct application of the Young’s inequality gives 

||u( 7 )(x,r)-u( 7 )(x,r)||^ + f ||'Vu(y) - S/u(^)\\^dt < CH 7 - 7 llr<> 
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from which and the trace theorem, we obtain 


[ \Win)-u^)\\l a dt<C j ||u(7) ~ u(l)\\l n dt < L||7-' 
/ 0 J 0 


lr,- 


To verify the estimate (14.111) . we first have by taking Lp = v!('y)d in (14.61) and then following the same 
technique as we did for (14.101) that 


\\u'h)dr dn dt<ch~j\\i. 


(4.13) 


Next, we take 7 = 7 and d = 7 — 7 in m to deduce 


/0 Jn 


3 i(u , ( 7)(7 - 7 ))ipdxdt 


/0 Jn 

r T 


a(x)V(^( 7 ) (7 — 7 )) • Vtpdxdt 


= [ f (—(7 ~ 7)^(7) — 7( u '(7)(7 ~ 7)))<pdsdt. ( 4 . 14 ) 

JO JTi 

Subtracting (14.141) from (14.121) gives 

f [ <9 t (u'(7)(7-7) - (u(7) - u(j)))ipdxdt + [ f a(x)V(u'(7)(7 - 7) - (14(7) - ^(7))) • V^dxdf 
do do do do 

+ / / 7{u\l){l - 7) - {u(i) - u{i)))ipdsdt = \ / (7 - 7 )(w( 7 ) - u{j))(pdsdt. 

Jo J iy do dr. 

Now applying the trace theorem, Lagrange mean value theorem and estimate (14.131) . we can derive 


[ Ik'(7)(7 - 7) - 0(7) - «(7))llr a dt < c [ ll u, (7)(7 - 7) - (w(7) - w(7))lli,n* 

do do 

< C / ll(7-7)(w(7)-w(7))llr i rfi = c ' [ 11(7 - 7K(0(7 - 7)11^^ < ci||7 - lllr*) 

do do 


where £ is some element in Lf between 7 and 7 . jj 

Now we are ready to establish a quadratic rate on the convergence of the Levenberg-Marquardt 
method, under the following basic condition: 


ll u (7) — u ( 7 *)\\r a dt > c 2 ||7 — 7 * Hr*» V 7 SA^( 7 *,&) (4.15) 

where c 2 and b are two positive constants with b £ (0,1). Assumption (I4.15[) is the frequently adopted 
basic condition to ensure the quadratic convergence of the Levenberg-Marquardt method for most direct 
nonlinear optimization problems [4] [15], so it is natural to bring it to the current nonlinear ill-posed 
parabolic inverse problem. The condition (14.151) may be viewed as a direct motivation of the local 
Lipschitz stability of the parabolic inverse Robin problems (see estimate m in Theorem 12.41) . 

It is a well-known technical difficulty in a practical numerical realisation of any Tikhonov regularised 
optimisation system like the ones m and dUD to choose a reasonable and effective regularization 
parameter /3 or /3k- The same as we did in Section f3.2l one of the important novelties of this work is our 
suggestion of a very simple and easy implementable choice of the parameter /?/. based on the rule: 



Pk = [ ||w(7 fc ) - z s \\r a dt, (4.16) 

Jo 

And surprisingly, as we shall demonstrate below, this choice of the regularization parameter f3k still 
ensures a quadratical convergence of the resulting Levenberg-Marquardt iteration (14.91) . 

Considering the presence of the noise (see (14.11) ) , it is reasonable for us to terminate the L-M iteration 
(1X51) when its minimizer 7 * is accurate enough in terms of the noise level, more specifically, we shall 
terminate the iteration if the following criterion is realised: 


Vc2\\7 k - 7*llr ; < 2(5 or 



— z s \\r a dt < S. 


(4.17) 
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Lemma 4.3. Under the conditions J^.15| ) ; 1 f.l0\j and if 7 k £ N(-y*, b), then 7 fe+1 generated by 

the iteration ra satisfies 



\\u\l k ){l k+l 


7 fc )-(^- U ( 7 fc ))||^^ < c 3 (|| 7 fe — 7*||r 4 + o ), 


ll7 fc+ 1 -7' 


fc||2 


< c 4 ( 11 7 fc — 7* Up. + < 5 ), 


(4.18) 

(4.19) 


where c 3 and c\ are two constants given explicitly by c 3 = max{2ci + 2L + l, 3} and C 4 = max{^ + l, 2}. 

Proof. As 7 fc+1 is a minimizer in (14.911 . we can derive by using the estimates (14.111 . (14.1011 - (14.1 111 . the 
equality (14.1611 and Cauchy-Schwarz inequality that 


[ T lK(7 fe )(7 fc+1 - 7 fc ) - (z* utfmljt < J( 7 fc+1 ) < Jin*) 

J 0 

= / ||u , (7 fe )(7*-7 fe )-(u(7*)-'a(7 fe ))+u(7*)-2: 5 ||^dt + ^ fc ||7*-7 fc ||^. 

J 0 

< 2c 1 || 7 fc - 7lr ( + 2d 2 + T \\u ( 7 k ) - «( 7 *) + «(7*) - - 7 fc ||r, 

J 0 

< 2c!||7 fc - 7*llri + 2d 2 + 2L|| 7 * - 7*11*. + 2d 2 || 7 * - 7 fc |lr i 

< (2ci + 2L + l)|| 7 fc — 7*||r 4 + (2 + d 2 )d 2 

< max{2ci + 2L + 1, 3}(||7 fc - 7*11^ + (5 2 ) 

= c 3 (|| 7 fe -7lr i +^ 2 ). 

Again, using the minimizing property of 7 k+1 in (14.91) and the estimates (14.11) and (14. IIP , we can 
deduce as follows: 


< 


||7 fc+ 1 -7 fc Hr j <^(7 fc+ 1 )<^(7*) 

-j- £ ||u'(7 fe )(7* - 7 fe ) - (z* ~ u( 7 k ))H 2 ra dt + || 7 * 

^-(2ci||7 fc -7lr i +2d 2 ) + ||7*-7 fc ||^ 

2ci|| 7 fc -7ll^ , 2d 2 ,* 

Jo IK7 fc ) - z 5 \\l a dt / 0 T ||w( 7 fc ) - z & \\l a dt 



(4.20) 


As stated in (14.171) . the iterative process (14.91) terminates if y/oi\\ 7 k — 7* ||r\j <2(5 or f 0 T ||u(7 fc )-z 5 ||2 £i( it < 
S. Otherwise we have yfcf || 7 fe — 7 *||r 4 > 2d and / Q T ||ii( 7 fe ) — z s \\ 2 a dt > d, which implies 

( [ T ||u( 7 fc ) - z% a dt)? > ( [ T ||n( 7 fe ) - u( 7 *)\\ 2 Ta dt)? - ( f T || U ( 7 *) - z*\\* a dt)i 

Jo Jo Jo 

> \/^ll7 fc -7*llr 4 — <5 > V^ll7 fc -7*llr i - ^||7 fc - 7*l|r i = ^l|7 fc - 7*l|rv 

Now the desired estimate (14.191) follows directly from (14.201) and the above two estimates. (I 

Lemma 4.4. Under the conditions J j-15\ ), |^.16’| ) and J^.17| ), let 7 k and y fc+1 be two consequent iterates 
generated by the iteration and satisfy that 7 k , 7 k+1 £ N{ 7 *,b), then 

||7 fe+ 1 -7lr i <c 5 (|| 7 fe -7l^+<5), (4.21) 


where C 5 is a constant given explicitly by C 5 = \J (2c 3 + 4cic 2 + l)/c 2 - 
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Proof. By direct computing and triangle inequality it follows from (14.151) . (14.1 II) . (14.181) and (14.191) that 


c 2 ||7 fc+1 -7*llr i < / lk(7 fc+1 ) - < f \\u(-y k+1 ) - z s \\l a dt + 5 2 

Jo Jo 

= [ T ll^(7 fc )(7 fc+1 - 7 fe ) + «(7*) - Z* - {«'(■7 fc )(7 fc+1 - 7 fe ) + utf) - tt(7* +1 )}|lL^ + & 

Jo 

< 2 f T ||M , ( 7 fc )( 7 fe+1 — 7 fc ) + u (l k ) — z s )\\ 2 a dt + 2 c 1 || 7 fc+1 — 7 fc ||r i + $ 2 

Jo 

< 2c 3 (|| 7 fc - 7*Hr* + <5 2 ) + 2^(117* - 7 *||^ + 5) 2 + <5 2 

< (2c 3 + 4c 1 c 2 + l)(|| 7 fc -7l^+n 

which leads to (14.211) directly. # 

In order to establish the quadratic convergence of the L-M iteration, we now emphasise the dependence 
of all the constants ci, ■ • •, C 5 in our previous estimates on the radius b of the ball IV ( 7 *, b). First, we 
can easily see that both constants c\ and C 3 in (14. lip and (14.181) are independent of b. But the constant 
C 2 in (14.151) depends on this radius 6 , so we will write 02(b) to emphasize this dependence. Similarly, we 
may also write the constants C 4 and C 5 in the estimates (14.191) and (14.211) as 04(b) and 05(b). 

We are now ready to establish our major convergence results in this work, the quadratic convergence 
and quadratic rate of convergence for the Levenberg-Marquardt iteration (14.91) . For simplicity, we set 


f b-Jc4(\)5. / ~ 1 

r(b,S) = min j b, - -}, a = (\/c 4 (-) + l)c 5 (~), 

1 v 3 3 

m = (yQi) + !)%(!)« + \jc,l\)S • (4.22) 


We can directly verify from the definitions of the constants C 4 and C 5 that 04 (b) > 2, 05 (b) > 2 and a > 3. 
Following the same arguments as the ones for Theorem 13.11 we can derive 

Theorem 4.1. Under the conditions )4-15\ ). b4-16\ ) an< J b4-17]) > we assume <5 is small enough such that 

f(b , <5) > 0, 1 — 4a0(6) > 0 and choose b £ j 1 1+ ^ 1 2a 4a -^^-], then for any 7 0 £ IV( 7 *, f(&, 6 )), 

the sequence { 7 fc } generated by \3.8\) stay always in N( 7 *, 6 ), and 


||7 fc+1 -7lr I <c 5 (i)(||7 fc -7l^+<5)- 


4.3 Surrogate functional method 

In each step of the L-M iteration we have to solve the minimization problem (14.91) . Let us now derive its 
optimality system, i.e., J'( 7 fc+1 )£ = 0 for any £ £ L 2 (Ti). By direct computations, we have 


J'( 7)£ = 2 / ( u, (7 fc )(7-7 fe )-(^-w(7 fe )),w'(7 fc )(C))r a dt + 2/3 fe (7-7 fe ,£)r i 

= 2 ( f T u( 7 fc )K(7 fc )*( M/(7fc)(7 ~ 7 " ) ^~ M(7fc)) )}^ Or, + 2/3 fe < 7 - J k , £>r 4 , 
Jo u( 7 fe ) 


where we have used the adjoint relation (14.51) . This is equivalent to the following equation: 



M,„u„M*y(l k )( 7-7 fe ) 


«(7 fc )K(7T(- 


u( 7 fc ) 


)}dt + /3 k ( 7 - 7 O 



uh k )Wh k r( 


z s - u("f k ) 
u( 7 fe ) 


)}dt. 


(4.23) 


So we have to solve this rather complicated linear system (whose discretized system is strongly ill- 
conditioned) to get the solution 7 fe+1 at each step of the iteration (14.91) . e.g., by some iterative method. 
This is still difficult and computationally rather expensive. 

Next, we shall make use of the surrogate functional technique in an attempt to greatly simplify the 
solution to the minimization (BID , resulting in an explicit solution at each iteration. The resultant 
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algorithm is computationally much less expensive. For the purpose, we construct an auxiliary surrogate 
functional J s {l,l k ) of J(y) of the form: 


J s (lM) = J( 7 ) + A || 7 7 fe ||r i - [ T \\n'h k )h 7 k )\\l a dt, 

Jo 


(4.24) 


where A is any positive constant such that J T _ ||w/( 7 fe )d||p dt < A||d||p. for d € L 2 (Tj). Now we shall 
convert the functional J s ( 7 , 7 *) in (|4.24J) into a more explicit representation. Using the adjoint relation 
m , we can rewrite J s ( l,i k ) as follows: 

J s (iM) = [ T ||« , (7 fc )(7 - 7 fc ) ^ (* 4 - «(7 fc ))ll^dt + Ml - 7*11^ + 4| 7 - 7 fc ||£ t 
Jo 

f \\u'{l k ){l-l k )\\l a dt 

Jo 

= -2 / T (u'(7 fe )(7-7 fc ),^-«(7 fe ))r 0 ^ + ^||7-7 fe ||^+A||7-7 fe ||^ 

JO 

+ f T \\z s — u( 7 fc )||p a dt 

= - 2(7 - 7 fe , £ utfHu'tfr e ~$ k) )}dt)r t + Ml 7 fc |& 

+^ll7-7 fe Hr i + / ll^-w(7 fe )llr a * 

./0 

= A\\! - 7 fe - ^ £ u ^ k )W^ k r C + Ml l k \\h 

+ { £ \\z* - u{i k )\\l a dt - A\\j£ uM){n\l k rC-£££)}dt\\l). (4.25) 

We note that the last term in (14.251) is a constant, so it does not affect the minimization. Hence we will 
drop that term in the functional J s (l,i k ) and consider the following minimization: 

min J s (i, i k ) = min j4|| 7 — i k j [ u{i k ){u'M )*(-— ,^7 ^ )}^||r, + Ml ~ 7 fc ||fv ( 4 -26) 

7 eif 7 6 if A J o u( 7 R ) 

This is a simple quadratic minimization, and it is easy to find its exact minimizer explicitly: 


argmin J s ( 7 , 7 fc ) = 7 fc + — 

7GiC ^ + Pk JO 


f T u(i k ){u'Mn zS £ k) )}dt. (4.27) 

Vo *H7 ) 


This motivates us with the following reconstruction algorithm for the Robin coefficient in (11.21) , which is 
clearly much easier and computationally much less expensive than solving the minimization (14.91) directly. 

Algorithm 4.1. Choose a tolerance parameter e > 0 and an initial value 7 , set k := 0. 

1. Compute 7 fc+1 ; 


l k+1 = 7 fc + 


r u(i k ){u\i k r( zs u £ ] )}dt. 
A + Pk Jo HI ) 


(4.28) 


2. If —n —0 -- < e, stop the iteration; otherwise set k := k + 1, go to Step 1. 


5 Numerical experiments 

In this section, we shall apply Algorithms 13.II and 14.II that were proposed in the previous Subsections 13.31 
and !4.3l to identify the Robin coefficients in the elliptic and parabolic systems m and m respectively. 
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Figure 5.1: Exact and reconstructed Robin coefficients for Example [371] (left: k = 13, the error = 0.0235) 
and Example 15.21 (right: k = 19, the error = 0.0270). 


We choose the domain Q = (0,1) x (0, 2) and triangulate it into TV x M small squares of equal 
size and further divide each square through its diagonal into two triangles. This results in a finite 
element triangulation of domain Q. All the elliptic problems involved in Algorithms 13.11 are solved by the 
continuous linear finite element method, while all the parabolic problems in Algorithm 14.11 are solved by 
the continuous linear finite element method in space and the backward difference scheme in time. 

The parameters involved in Algorithms 13.II and 14.11 are chosen as follows. The initial guesses are set 
to be identically equal to some constants, which as we see are rather poor initial guesses for all the test 
problems. The noisy data z s is obtained by adding some uniform random noise to the exact data, i.e., 
z s = u + SRu , where R is a uniform random function varying in the range [-1,1]- The errors are the 
relative L 2 -norm errors ||'y fc — 7*||/||7*||, where 7* and 7 fe are the exact parameter and its numerical 
reconstruction by Algorithms 13.11 and 14.11 at the fcth iteration respectively. 

We start two numerical tests for the Robin coefficient reconstructions on the partial boundary Tj = 
{( x,y ); x = 1, 0 < y < 2} in the elliptic system (11.111 . where we take a(x) = c(x) = 1 in Q, the 
ambient temperature g = 2 + (cos(7r y) + l) 7 (x) on T^, the heat flux ft = 0 on T a , the source strength 
/ = (7r 2 +1) cos(7 ry) +x 2 — 2 and the exact forward solution u = x 2 + cos(ny) in f1. We set the noise level 
S = 2%, the mesh N = 16 and M = 32, the tolerance parameter e = 2 x 10~ 3 and the constant A = 1. 

Example 5 . 1 . We take the exact Robin coefficient 7 = 3 — sin(^?/) and the initial guess 7^ = 2. 

Example 5 . 2 . We take the exact Robin coefficient 7 = (y — l) 2 + 2 on {(x,y) 6 T*; 0 < y < 1 } and 
7 = —(y — l) 2 + 2 on {(a;, y) £ Tj; 1 < y < 2 } and the initial guess 7^ = 2. 

Figure l5Jl (left 1 and Figure lSJl fright ) give respectively the exact and reconstructed Robin coefficients 
for Examples 15.11 and 15.21 We see from the figure that the numerical reconstructed Robin coefficients, 
with a 2 % noise in the data and very bad constant initial guesses, appear to be quite satisfactory, in 
view of the severe ill-posedness of the inverse Robin problem. We can also clearly see that Algorithms 
13.11 converges quite fast with less than 20 iterations. 

Next, we demonstrate two numerical examples of reconstructing the Robin coefficient y(x) on the 
partial boundary Tj = {( x,y ); x = 1, 0 < y < 2} in the parabolic system (11.21) with a(x) = 1. We take 
the ambient temperature g = (2 + (cos(7 ry) + l) 7 (x))f on Ti x [0, T], the heat flux ft = 0 on r o x [0, T], the 
source strength / = cos(7 ry) + x 2 + (7 r 2 cos(7 ry) — 2)t and the exact forward solution u = (x 2 + cos(ny))t 
in fl x [0, T]. We set the noise level 5 = 2%, the mesh A* = 16 and M = 32, the tolerance parameter 
e = 5 x 10 -3 , the constant A = 1 and the terminal time T = 2. 

Example 5 . 3 . We take the exact Robin coefficient 7 = — (y — l ) 2 + 2 and the initial guess 7 ^ = 2. 
Example 5 . 4 . We take the exact Robin coefficient 7 = ^(sin(^ 2 /) + y3) + l and the initial guess 7 ® = 2. 
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Figure 5.2: Exact and reconstructed Robin coefficients for Example 15.31 (left: k = 14, the error = 0.0281) 
and Example 15.41 (right: k = 12, the error = 0.0270) 


Figure lQU left'l and Figure[A2] (right) give respectively the exact and reconstructed Robin coefficients 
for Examples 15.31 and 15.41 We see from the figure HT2l that the numerical reconstructed Robin coefficients, 
with a 2% noise in the data and very bad constant initial guesses, appear to be quite satisfactory, in view 
of the severe ill-posedness of the inverse Robin problem. And we also note that Algorithm 14.11 converges 
quite fast with less than 20 iterations. 

6 Concluding remarks 

We have justified in this work the uniqueness of the elliptic and parabolic Robin inverse problems. Then 
the Levenberg-Marquardt iterative method is formulated to solve the nonlinear Tikhonov regularized 
optimizations, which transform the original highly nonlinear and nonconvex minimizations into convex 
minimizations. We have established the quadratic convergence and the quadratic rate of convergence 
for the L-M iterations for the highly ill-posed nonlinear elliptic and parabolic Robin inverse problems. 
This appears to be the first time in literature to achieve the quadratic convergence and the quadratic 
rate of convergence for the L-M iterations rigorously for a highly nonlinear and ill-posed inverse problem, 
in combination with a simple and easily implementable choice rule of regularization parameters. The 
surrogate functional techniques have been applied to solve the convex minimizations at each L-M iteration, 
which lead to explicit expressions of the minimizers for both the elliptic and parabolic cases, resulting in 
two computationally very efficient solvers for the highly ill-posed nonlinear inverse problems. Numerical 
experiments have demonstrated the computational efficiency of the methods and their robustness against 
the noise in the observation data. 
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